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ABSTRACT 



Bryn Mawr Reviews (BMR) produces two electronic review 
journals, "Bryn Mawr Classical Review, " (BMCR) which also comes out in paper 
and "Bryn Mawr Medieval Review" (BMMR) . BMR has two sets of users: 
subscribers and gopher hitters. Analysis of the monthly gopher reports has 
concentrated on the hitters rather than the hits; analysis of total users 
shows that use has leveled off at a peak of about 3800 users a month. 
Subscriptions to the electronic journals continue to grow at a rate of 5% per 
quarter, though there are considerable seasonal fluctuations. In terms of 
progress and cost recovery, progress is satisfactory but cost recovery is 
still uncertain. BMCR is growing at the rate of 30% a year. About half the 
costs of BMCR goes for producing the paper version. A possible reduction in 
costs besides elimination of the paper version and automatic mark-up is a 
"fast-track" system whereby the review never leaves the Internet. The great 
advantage for the reviewer is that this cuts publication time by a month; the 
disadvantage is that the reviewer is asked to do some simple mark-up on the 
text before sending it. Seven charts show statistics. (AEF) 
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Historical Background 

Bryn Mawr Reviews (BMR) produces two electronic review journals Bryn Mawr Classical 
Review (BMCR), which also comes out in paper and was started at the end of 1990 and Bryn 
Mawr Medieval Review (BMMR), started in 1993. After about two years of activity BMMR 
became dormant and toward the end of 1996 both location and management were shifted hJ; 
since then it has become tremendously active, at one point even surpassing BMCR in its 
monthly output.^ The comparisons below should be considered with this in mind. 
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Data 

We have two sets of users: subscribers and gopher hitters.^ As data from the former we have 
subscription lists, which are constantly updated, and periodic surveys that we have conducted; 
for the latter we have monthly reports of gopher hits and gopher hitters (but not what the hitters 

BEST COPY AVAILABLE 2 



12/1/97 12:59 PM 



AKLVs Scholarly Communication and Technology -Project 



http://www.arl.org/scomm/scat/hamilton.htmi 



hit). In considering this data our two main questions have been: how are we doing; how can we 
afford to keep doing it. 



A. Gopher Reports 

Our analysis of the monthly gopher reports has concentrated on the hitters rather than the hits. 
After experimenting rather fruitlessly in 1995 with microanalysis of the data from the 
Netherlands and Germany hitter by hitter month by month for a year, we decided to collect only 
the following monthly figures: 

total # users 

total by address (country, edu, com etc.) 

list of top hits (those reviews that received 15+ hits/month and are over a year old^) 
list of top hitters (those who use the system 30+/month). 

Analysis of the total users shows that use has levelled off at a peak of about 3800 users a month 
(see appendix). With a second full year of gopher use to study we can see the seasonal 
fluctuation more easily. The one area of growth seems to be non-English foreign sites. If we 
compare the top hitters in the first ten months of 1995 with the comparable period in 1996 we 
find that the total increased only 5% but the total number of non-English heavy users increased 
120%. Three countries were among the heavy users in both 1995 and 1996 (France, Germany, 
Netherlands); two appeared only in 1995 (South Africa, Taiwan) and eight only in 1996 (Brazil, 
Italy, Ireland, Poland, Portugal, Russia, Spain, Venezuela). 

Chart 1: BMCR/BMMR Top Hitters (30+ hits a month) 

US English Non-English Total 

1995 47 8 5 60 

1996 42 10 11 63 

In terms of number of total users from 1995 to 1996 there was an overall increase of 10.8%, 
though the increase among US users was only 9.1%. Conversely, most foreign countries if 
anything showed a marked increase in total use over the ten months of 1996 vs 1995 (see 
appendix): Argentina 16 to 27, Australia 542 to 684, Brazil 64 to 165, Denmark 80 to 102, 
Spain 107 to 197, Greece 41to 80, Ireland 50 to 69, Israel 89 to 108, Italy 257 to 359, Japan 
167 to 241, Korea 26 to 40, Netherlands 273 to 315, Portugal 16 to 26, Russia 9 to 27, 
(former) USSR 13 to 20, and South Africa 63 to 88. On the other hand, Iceland went from 22 
to 8, Malaysia from 30 to 21, Mexico from 68 to 56, Sweden from 307 to 250, and Taiwan 
from 24 to 14. Also, among US users there was a large drop in edu from 7073 to 5962 and a 
corresponding rise in ngl from 1570 to 41 1 8, perhaps because faculty members are now using 

commerical providers for home access.^ 

In the analysis of top hits a curious pattern emerges: BMMR starts out with many more top hits 
despite there being a much smaller number of reviews (about 15% of BMCR's number) but 
toward the end of 1995 the pattern shifts. BMMR dominates at the beginning but drops when 
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BMMR becomes inactive. 

Chart 3: Favorite Reviews (reviews at least one year old that received 15+ hits/month) 
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The shift is easily explained since it occurs about the time BMMR was becoming inactive, but 
the original high density is still surprising.^ Likewise medieval books receive noticeably more 
attention: 32 medieval titles made the top hits list 116 times (avg 3.6) while 81 classical titles 
made the list only 219 times (avg 2.7), despite including two blockbuster titles, Amy Richlin's 
Pornography and Representation (lOx) and John Riddle's Contraception and Abortion 
t (14x).^. My guess is that medievalists, being more widely dispersed in interests and location, 
have found the Net more important than have classicists, who are mostly located in a classics 
department and whose professional work is more circumscribed (and has a longer history). 



B. Subscriptions 
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Subscriptions to the e-journals continue to grow at a rate of 5% per quarter, though there is 
considerable seasonal fluctuation: 



Chart 4: Subscriptions 
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Looking more broadly we see a steady slowdown in growth of all but the joint subscriptions: 
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If we look at the individual locations, we find again that while the US subscriptions continue to 
grow, they are becoming steadily less of the whole, going from 77% of the total in 1993 to 68% 
in 1996. English-speaking foreign countries have remained about the same percentage of the 
whole; it is non-English speaking foreign contries that have shown the greatest increase, going 
from 4% of the total in 1993 to 13% of the total in 1996. 



Chart 5: BMCR Subscribers 
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C. Subscriber Surveys 

As opposed to the gopher stats, which give breadth but little depth, our surveys offer the 
opportunity for deeper study of our users but at the expense of breadth. We cannot survey our 

subscribers too often or they will not respond.^ A further limitation is that we felt we could not 
survey those who take both BMCR and BMMR, a significant number, without skewing the 
results since many subscribers lean heavily toward one journal or the other and the journals are 
significantly different in some ways. So far we have conducted five surveys: 

1) a 20 question survey to BMCR subscribers November 1995 

2) a 21 question survey to BMMR subscribers in February 1996 

3) a 2 question survey to all subscribers in October 1996^ 

4) a 15 question survey to all BMCR reviewers whose e-mail addresses we knew in January 
1997. 

5) a 2 question survey to those who have cancelled subscriptions in the past year (March 1997). 



Here is the subscriber profile as revealed in the surveys: 
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Many of the differences are easily explained by the chequered history of BMMR or by the 

differing natures of the two readerships. I doubt many will be surprised that medievalists are 
more often female and less often faculty. The paucity of reader-reviewers of BMMR reflects the 
paucity of BMMR reviews. To me the most surprising statistic is how few of subscribers to 
either journal have used gopher. 

The key question of course is willingness to pay for subscription, and with that in mind we did 
some correlation studies for the BMCR survey, first seeing with what variables there was a 
correlation with a willingness to pay $5 for a subscription. We found positive correlation with 

ever found review useful for teaching (.0004 likelihood of a chance correlation) 

ever found review useful for research (.00006) 

ever hear a reference to BMCR (.00001) 

ever written a review for BMCR (.00089) 
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Some further correlations were found: 

start to read many or most reviews// heard a reference to BMCR (.00014) 

willing to review// heard a reference to BMCR (.00003) 

get paper BMCR// have written review (.00003) 

have written review// will write in future (.0000) 

will write in future// library gets BMCR (.00007) 
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PhD// willing to review (.00001). 



A follow-up two question survey done in October 1996 asked whether subscribers would prefer 
to pay for e-mail subscription, or to receive advertisements from publishers or to cancel. 14% 
preferred to pay, 82% to receive advertisements and 4% to cancel. 

Our most recent survey, of those who had for one reason or another dropped from the list of 
subscribers, revealed that almost a third were no longer valid addresses and so were not true 
cancellations. Of those who responded almost half (40, 44%) of the unsubscriptions were only 
temporary. The reason for cancellation was rarely the quality of the review. 

Chart 7: BMCR Unsubscriber Survey (those who unsubscribed 1/96-2/97) 

317 total: 103 address no longer valid; 91 responses 



identity 
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2 decided review quality not high enough (+1) 
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7+1 no longer have time to read reviews (+2) 

7+1 other (5 shifted to BMR, 1 to BMCR, mistake) (4+1) 
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Conclusions 

If we return to our two questions: progress and cost recovery, we can see that our progress is 
satisfactory but cost-recovery is still uncertain. 

BMCR is growing at the rate of 30% a year.hh The major American Classics organization (The 
American Philological Association) has a membership of about 3,000 members and so one may 
estimate the total world population of Classicists as somewhere between 7,000 and 10,000. If 
half of them have access to computers, BMCR presently reaches somewhere between 22% and 
32% of its total market. At its present rate of growth, it will saturate its market in five years. It 
is much more difficult to estimate the total world market for BMMR, but it is certainly greater 

than that for BMCR, so with its present growth rate of perhaps 30%h-2J it will take somewhat 
longer to reach saturation. 

BMCR costs are about $4, 000/year for over 700 pages of reviews. About half the cost goes for 
producing the paper version and we anticipate costs of between $1,500 and $2,000 per year for 

preparing reviews for the Web.h*^ Uncompensated editorial time averages 34 hours/month. So, 
total out-of-pocket expenses could be as high as $6,000 if the paper version continues and if 
mark-up continues to be done by hand. A third possible reduction in costs besides elimination of 
the paper version and automatic mark-up is a "fast-track" system whereby the review never 
leaves the net: it is e-mailed to the editor who sends it to a member of the editorial board and 
when the two have made changes it is sent back to the reviewer for approval and then published 
on the net. The great advantage for the reviewer is that this cuts publication time by a month; 
the disadvantage is that the reviewer is asked to do some simple mark-up on the text before 
sending it. 

Possible revenue sources include: advertising, subscriptions and institutional support. As we 
have seen, our subscribers much prefer receiving advertising to paying for a subscription, but we 

have no idea how successful we will be in attracting advertising.^^ At the Conference, Hal 
Varian suggested we try to arrange something with Amazon Books, and we will. We will not 
consider charging for subscriptions until BMCR is on the Web; at that point we could charge 
for timely delivery of the review, perhaps several months before universal access. We also want 
to wait for wide acceptance of a simple electronic cash transfer system. Institutional support 
seems to us the most obvious way to cover costs since the College gets considerable exposure 
for what seems to us a small cost. 



ERiC 



8 oi 



12/1/97 12:59 PM 



AKCs scnolarly communication and lecnnology Project 



nttp: // www. arl .or g/scomm/scat/ Hamilton .ntmi 



BMCR/BMMR total gopher users 
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Footnotes: 



- It has as of May 7 become The Medieval Review (TMR). 

- The output by month (4/95-3/97) is: 

9 8 

28 14 
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bmmr 10 17 58435 11 674614166 

bmcr 15 14 19 13 11 29 26 17 27 12 14 15 37 7 12 19 17 
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2 Since May 7, BMMR (=TMR) has been on the Web, and this will eventually provide valuable 
data to compare with the BMCR gopher data. 

4 Naturally, new reviews are visited often; we are trying to isolate those of enduring value. 

^ Likewise, mil(itary) dropped from 310 to 186; gov(ernment) from 819 to 409. 

“ The explosive growth in 9/95 and 10/95 was only temporary. 

2 The difference would be even more pronounced had I not excluded books that appeared on 
the list only once. In 1996 the gap virtually disappears: 31 medieval titles (total number of titles 
53) made the list 126 times (avg. 4.1) while 93 classical titles (total number of titles 169) made 
the list 360 times (avg. 3.9). 

“ As is our response rate is only in the 30-40% range. 

° Unfortunately the survey was worded as if only for BMCR subscribers, but even so the 
response rate was about 35%. 

^ We found similar differences in a pilot comparison of qualitative differences in the two 
journals done by two advanced graduate students (one a Classicist one a Medievalist ) in the 
summer of 1995. They concluded that the major differences stem from the scholarly orientation 
of either discipline not from their media (i.e., Classicists criticize at a microscopic level, assume 
in-depth acquaintance with a given text). The reviews are longer and the number of 
typographical errors is much greater in BMMR but other differences seemed to be personal 
(tone of the review, footnotes and additional bibliography, organization, amount of direct 
quotation). 

^ Combined BMCR and joint figures= 912 for 1993, 1342 for 1994 (+47%), 1734 for 1995 
(+29%) and 2264 for 1996 (+30%). 

12 Combined BMMR and joint figures= 518 for 1993, 958 for 1994 (+85%), 1464 for 1995 
(+53%) and 1765 for 1996 (+21%). We have already seen an increase since BMMR relocated 
(3/97 = 1985, c.30% annually) and we may expect a considerable bump after official unveiling 
of TMR at the annual conference in May (and the introduction of the website). 

BMMR has found it takes 35 minutes on average to SGML a review. 

— So far only Princeton University Press (of the eight contacted) has signed up for 
e-advertising. 
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For additional information about the conference, or The Andrew W. Mellon Foundation 's scholarly 
communication initiatives, please contact Richard Ekman . For additional information about ARL or this 
web site contact Patricia Brennan . ARL Program Officer at (202) 296-2296. 
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